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ABSTRACT 

The College-Level Academic Skills Test (CLAST) is 
part of Florida's system of educational accountability that is 
mandated hy state law. The CLAST is an achievement test measuring 
students attainment of coJ lege-level communication and mathematics 
skills identified by faculties of community colleges and state 
universities. Since August 1, 1984 students in public institutions in 
Florida have been required to have CLAST scores that satisfy state 
standards for the award of an associate in arts degree and for 
admission to upper division status in a state university in Florida. 
In addition, students in private schools may need CLAST scores to 
receive state financial aid. The CLAST consists of essay, English 
language skills, reading, and mathematics tests. Test development is 
traced, and the test itself is described, along with scoring and 
administration information. Summary data are presented for first-time 
takers in 1991-92 classified by race/ethnicity and gender, as well as 
college status. Fifty-six percent of students passed the CLAST in 
June 1992. Fourteen tables present test data for the 1991^92 school 
year. Six appendixes describe the test in greater detail and list 
College-Level Academic Skills Project (CLASP) and state-level task 
force members, 1991-92. (Contains 15 references.) (SLD) 
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I. OVERVIEW 



The College-Level Academic Skills Test (CLAST) is part of Florida's system of educational accountability 
and is mandated by Section 229^51(3)(k), FS. The CLAST is an achievement test measuring students' 
attainment of college-level communication and mathematics skills identified by faculties of community colleges 
and state universities through the CoUege-Level Academic Skills Project (CLASP). The skills (Appendix A) have 
been adopted by the State Board of Education (SBE) through Rule 6A-10.0310, FAC. Provisions for keeping 
the skills list current, maintaming active participation of faculty members in the implementation of the testing 
program, and administering the test are provided in the CLAST Test Administration Plan. 

The CLAST consists of four subtests: Essay, English Language Skills (measurijv? objective writing skills), 
Reading, and Mathematics. Each subtest yields a single score reported to the student and to the institution need- 
mg the scores. Students also receive broad skiU information useful in identifying areas of possible strength or 
weakness. While the CLAST does not yield the skill-by-skill information necessary for full diagnosis of individual 
student needs, mstitutions can identify ai eas of need for groups of students by aggregating scores into broad skills 
over several administrations. Although CLAST scores relate positively to otiier measures of academic perform- 
ance, they do not predict examinees' future performance in upper division programs. 

Since August 1, 1984, students in public institutions m Florida have been required to have CLAST scores 
that satisfy the standards set fortii in SBE Rule 6A-10.0312, FAC, for die award of an associate in art« degree 
and for admission to upper division status in a state university in Florida. In addition, students in private 
mstitutions may need CLAST scores to receive state financial aid. 

Statutes and rules pertaining io the CLAST requirement are contamed in the CLAST Test Administration 

Plan. 



■ Eligibility to Take the CLAST 

The CLAST may be taken by any student who seeks an associate in arts or a baccalaureate degree, has 
at least eighteen credit hours, and applies to take the test by the deadline established for registration. Students 
who have previously taken the CLAST and have not passed all subtests may apply at any regular administration 
to retake the subtest(s) not passed. 

In addition, participating colleges and universities are to register other students who meet either of the 
followmg criteria: 

1. The students are eligible to participate in a State of Florida financial aid program eovemed by SBE 
Rule 6A-20.005, FAC. i' 6 ^ 

2. The students are required under provisions of SBE Rule 6A-20.005, FAC, to "-ave CLAST scores to 
continue tiieir eligibility beyond the academic term in which they register for the CLAST. 

Although CLAST scores are not needed to receive an associate in science degree, students who are m 
that program may be registered for the CLAST if they satisfy the requirements for (1) the associate in arts 
degree or (2) admission to upper division status. 

. . ^ .regi-stration of students for the CLAST must be made in an institution that can determine 
the ehgibihty of apphcants to take Ae test. Thus, registration normally will be done by the institution in which 



. 1 . 



5 



students are enrolled during the term in which they will take the test. However, an applicant for upper division 
status at a state university who needs CLAST scores and meets other eligibility requirements but is not enrolled 
m an mstitution that administers the CLAST may be registered for the test m the institution that needs the 
scores. 

Students must apply to take the test on or before the re^tration deadline established for that 
administration. Students may not retake any subtest for which they already have a passing score. Students may 
not retake any subtest prior to thirty days from the previous administration of the subtest. 



■ Test AdministfBtion Plan 

Under provisions of Section 229J551(3)(k), Florida Statutes, the Commissioner of Education maintains 
statewide responsibility for the administration of the CLAST. 

A plan for the administration of the CLAST for the 1991-92 academic year was issued by the 
Commissioner in September 1991. The plan, developed by the Department of Education, assigns administrative 
responsibility for the CLAST at three levels: the Department of Education; the Statewide Test Administrator 
(a technical support contractor); and the community colleges and state imiversities which administer the test to 
eligible students. The Offi»:e of Instructional Resources of the University of Florida is the Statewide Test 
Administrator. 

The plan also describes the policies and procedures under which the testing program operates. The 
CLAST Test Administration Manual and the CLAST Institutional Test Administrator's Manual, which are made 
part of the plan, give additional specific information to assist institutional personnel in carrying out their 
responsibilities. 
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\l DEVELOPMENT OF THE CLAST 



The test development process for the CLAST began with identifying skills to be assessed and continues 
wth developmg items for inclusion m the test. This chapter describes the major developmental efforts 
culmmatmg m the first test administraUon, the item development procedures, and the development of standards 
(passing scores). 

■ Background 

Inl979theHoridal^gislature,throughFloridaStatute79-222(nowSection229351),enatt 
reqmrmg the identification of skills to measure the achievement of essential academic skills of coUege students 
The Department of Education then charged the ArticulaUon Coordinating Committee with the task of 
implementing that part of the legislation dealing with the identification of skills and tests to measure achievement 
of those skills. The result was the establishment of the Essential Academic Skills Project (EASP now CLASP) 
The EASP mcluded an executive committee, a project director, a state-level task force on communication, a 
state-level task force on computation, and a state-level standing committee on student achievement Members 
of these initial groups are identified in the CLAST Technical Report, 1982-83; current members are identified 
m Appendix B. 

■ Identification of Skiils 

The state-level task forces, together with the project director and other project personnel acting in an 
advisory capaaty, worked to identify essential academic skills that every student, regardless of major, should have 
acquired by the end of the sophomore year. The task forces worked through a series of meetings from January 
to November of 1980 with mput from institutional-level task forces that had been established to involve faculty 
members m Florida s pubhc universities and community colleges in the identification of the skills. 

The task forces identified four generic competencies (reading, listening, writing, and speaking) in 
commumcation and four generic competencies (algorithms, concepts, generalizations, and problem solS m 
computation. Each generic competency was subsequently reviewed and broad skill categories were developed 
tor each competency. ^ 

Sldlls were then cicveloped for each broad skill category. These skills were presented to a random 
sample of faculty members from broad discipline areas in Horida's public community coUeges and universiUes 
Based on the results of the survey, the task forces made recommendations to the SBE. In September 1981 the 
fu 7.1 , recommended by the task forces. During 1985 and 1989, an extensive review of 
/ r ,noc . ^ addition, deletion, and/or modificaUon of some of the original skills. As a result 

f II iLt ^ '^^^ ^'"^ ^^^^P'^*^ ^^^^ bee° measured by the CLAST since the 

f J?, Il^f f ^r^. '"^^^ '^'"^^^ fro'" the 1989 review wiU be incorporated into 

the CLASPs fall 1992 admmistration. 
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TABLE 1 

Communication and Computation Competencies and Broad Skills 



COMMUr«CATI0N 



READING 

Utaral Comprahantion 
Critical Comprahanaion 

LISTENING 

iJtaral Comprahanaion 
Critical Comprahanaion 



WRITING 



Multlpta-Choica 
Word Choica 
Santanoa Structure 
Grammar. Spaiiing, 

Capitalization, and Punctuation 

Essay 

Suitability to Purpose and Audience 
Effactivanaaa and Conformity to Standard 
English 



SPEAKING 



Composition of Message 
Transmission of Message 



COMPUrATlO N 

ALGORITHMS 

Arithmetic 

Geometry and Measurement 
Algebra 

Sutistlcs. including Probability 
Logical Reasoning 

CONCEPTS 

Arfthmetic 

Geometry and Measurement 
Algebra 

Statistics, induQi/q Probability 
Logical Reasoning 

GENERALIZATION 
Arrthmetic 

Geometry and Measurement 
Algebra 

Statistics, including Probability 
Logical Reasoning 

PROBLEM SOLVING 
Arithmetic 

Geometry and Measurement 
Algebra 

Statists s, including Probability 
Logical Reasoning 



■ Rwiew of Available Tests 

Once the skills had been identified, the Standing Committee on Student Achievement, with the assistance 
of project staff, began its task of identifying tests and other assessment procedures that could be used to measure 
achievement of the skills. To accomplish the task, an extensive search was conducted to review commercially 
available tests and tests developed by community colleges and state universities which might be appropriate for 
measuring achievement of communication and computation skills. Sixty-six communication tests and fifty-four 
computation tests were reviewed in depth. Though all of the tests addressed some of the skills, none was judged 
adequate for measuring all of the skills identified in SBE Rule 6A- 10.0310, FAC. 

It was recommended that three multiple-choice subtests be developed in the areas of writing, reading, 
and computation. Since all of the writing skills could not be tested using a multiple-choice format, it was further 
recommended that an essay test be developed to measure the entire set of writing skills. Although it was 
determined that the identified listening and speaking skills should be acquired by students upon completion of 
their sophomore year, no statewide tests were developed to measure student achievement of Ibose skills. 

A more detailed report on the test search may be found in Test Search and Screen for Collet-Level 
Communication and Computation Skills (Department of Education, May 1981). 
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■ Development of Test Specifications 

Specifications for a test th^it could be used to measure the achievement of the skills listed m SBE Rule 
6A-10.0310, FAC, were developed between April and August of 1981 by the project director and staff, with assis- 
tance from the Standing Committee on Student Achievement, the communication and computation task forces, 
and measurement consultants. Recommendations of state-level task force members about the assessment of the 
skills, as well as practical and measurement issues, were con^dered m determining the nature of t'ie subtests and 
the number of items to be included in each subtest. These same procedures were followed for revising the test 
specifications necessitated by the 1985 and 1989 skill revisions. Specifications for the 1991-92 forms are described 
in Chapter III. 



■ Dwelopment of item Specifications 

After test specifications were developed, formulation of item specifications began. During the fall of 
1981, item specifications were written for the readmg and writing skills as well as for the computation skills deal- 
ing with algorithms and concepts. In 1983, item specifications for computation skills dealing with generalizations 
and problem solving were written and reviewed. Concurrently, the original specifications for the essay, writing, 
and reading items were reviewed again and revised as necessary. This process was repeated following the 1>85 
and 1989 skill revisions. 

All specifications were written by the chairpersons of the state-level task forces with assistance from task 
force members, standing committee members, content and measurement consultants, and Department of Educa- 
tion staff. Reviews of the specifications were conducted by faculty members from community colleges and state 
universities. 

Item writers used the item specifications as guides for item content aiid format. Copies of item 
specifications were distributed for use in all thirty-seven community colleges and state universities to aid faculties 
in planning for instru :tion and assessment of the skills. Copies of item specifications are available in the 
institutions as well as from the Department of Education. 



■ Development of items 

Items are developed for the CLAST through contracts with postsecondary faculty who write, review, 
pilot-test, and revise items based on item specifications and recommendations of state-level item review commit- 
tees. Items developed under these contracts are submitted to the Department of Education for field-testing and 
analysis. The following procedures are used to develop and approve test items for the CLAST. 

1. A contractor is selected based on its qualifications, including its past performance as an item 
developer and the qualifications of its item writers and reviewers. 

2. ITie contractor holds a training session for item writers and reviewers to discuss test security issues, 
the purpose of the CLAST, the use of item specifications, characteristics of good test items, item bias 
issues, and specific assignments to the contractor. 

3. Initial drafts of items are wr'*ten and reviewed by members of the contractor's item writing team. 

4. Items are pilot-tested with coUege students, and the results of the pilot test and suggestions from 
other item writers are used in revising the items. The pilot lest involves admmistering each item to 



about thirty students and interviewing at least five of them to obtain specific information about the 
items. 

5. Based on pilot-test data, items are reviewed and revised by members of the contractor's review team 
who have not been involved in the item writing. Attention is ^ven to content^ measurement, and bias 
issues (Appendix C). 

6. Revised items are submitted to the Department of Education, and a state-level committee is convened 
to review the items and recommend revisions and/or deletions in the contractor's set. 

7. Based on state-level review, items are revised by the contractor's team and submitted to the 
Department of Education in fmal form. 

8. Items are then included in the CLAST as developmental items and are not counted as scored items 
for students. This produces classical and Rasch item statistics for evaluating item quality. Items are 
screened based on the following criteria: p-valuc greater than or equal to .40, point-biscrial greater 
than or equal to .30, Rasch fit between less than or equal to 3.0, and Rasch total fit less than or equal 
to 1.0 + 3 standard errors. These criteria represent an ideal level of functioning for an item. If the 
item point-biserial statistic is less than 030, the item may still be considered for use on a future 
examination if it measures an important dimension of a required objective. Items are not used if the 
point biserial correlation coefficients are close to or less than zero. 

9. Essay topics are field-tested by a qualified contractor. Data generated for topic evaluations include 
distribution of scores, number of essays written, number written off topic, mean score, median score, 
percentage of complete agreement between raters, percentage of agreement within one score point, 
alpha coefficients with and without referee, and reader comments. Topics are evaluated in terms of 
clarity, relevance and appeal to the target population, and suitability for development of an essay; 
topics are also screened for potential biasing elements. The contractor recommends the topics 
suitable for inclusion in the CLAST and identifies any potential problems. 

In 1991-92 the Department of Education awarded a grant to Florida State University to develop CLAST 
items for the Readmg, Mathematics, and ELS subtests. Appendix D lists the members of the item-development 
team. 



■ DeveJopment of CLAST Standards 

CLAST standards (passing scores) were set by the SBE in March 1984. The passing scores refl'jcted 
the judgment of a state-level panel of interested persons concemirg the minimuTi level of performance 
acceptable for the successful completion of the sophomor'i year m community colleges and state universities in 
Florida. SBE Rule 6A-10.0312(1), FAC, establishes mmimum standards, in terms of scaled scores, for each 
CLAST subtest for specified periods of time (Table 2). Students are required to meet the set of standards in 
effect when they first take the CLAST. 
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chapter describes the guideLr admuustration procedures are standardized. This 

a Tesf Speoifications 

howeverfSf tstlL^;^^^^^ ntS ^ ^J^^^^^^^ ^ -ted; 

in order to collect dat'a needed t^ I^i uemrtote U^^ Dev«lopn,ental .terns are embedded in each test fonn 

UnguagrslS!t'd\rcLtsu^^^^^^^ ' ^ ^ '^^'^^^ ^^^^ 

test book. ''•^ Mathematics subtest is in a separate 



■ Item Bank 

are revised. Ne^ items Te ldLTo hi 2^1 fT «™'<1 P'~«si"g Gle tha. are updated aT items 

admirustraUon. "f "« developmental items from ead, 

test formt S^th^le^X^roSS T ^""^ ""^ " " »'">'<'° 

item flag, date used, and tes^ fo™ sS„T5 , * TJ" ? ""J', broad skill code, 

Raseh .gfieulty, fAt^^S rmd^dt^t^L"!^^^^^^^ "™ ■""'•"-"^ 

for six admini.,trations Afiir that TlnT, . / "™- '"' ^ept in the active Die 

rotated to remove thtdau LmlreiL^a'Sati:^ ~ 

■ Test Assembly 

.elected foll;t£rSe^n«T«^irJr ""^ '° '^^ 'P-^'W--- are 

selecUon process. TesTfom Uem dffil^S ^ between forms. CurreM item difficulty values are used in the 
occur, paiicularly i."L r™<W tSS f -, '"P's- Small variations in mean dUHculty 

.0 the Lmou sLe V^^^^ ^^Sr d^iS t ffl^ " 
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TABLE 3 

CLAST Specifications by Subtest, 1991-92 


SUBTEST MKl BROAD SKILL 

1 II 1 1 


NUMBB^OF 
SKUIS 


NUMBS^ OF ITEMS 








ESSAY 










(Holittically scored; not t«8t»d 










with obj(»ctive H«ms.) 










ENGLISH LANGUAGE SKILLS 










Word Choice 


2 


6 






Sent«nc« Structure 


4 


13 






Grammar, Spellino, 










Capitalization, and Punctuation 


5 


16 






Total 


11 


35 




40 


READING 










Utaral Comprehension 


3 


9 








Q 


27 






Total 


12 


36 


T 


"41 


MATHEMATICS 










Arithmetic 


13 


13 






Algebra 


16 


16 






Geometry and Measurement 


10 


7 






Logical Reasoning 


8 


7 






Statistics, including Probability 


9 


7 






Total 


56 


50 




55 



The plan for format and arrangement of items in test forms is mtended to make each form attractive 
and eas> o read. Multiple-choice writing items are grouped by format and content to make the test time- 
efficient for students. 



■ Test Instructions 

General instructions provided to students contain information about scoring, recording answers, the 
number of items, and the time allotted for each subtest. Directions state that scores are based on the number 
of right answers vAih no correction for guessing. 

The CLAST is administered in one session^ which requires nearly five hours. Although actual testing 
time is four hours, additional time is required to check in examinees, code identifying information, distribute and 
collect materials, read directions for each subtest, and provide a ten-minute restroom break. The Essay test is 
administered first, and students are allowed 60 minutes to complete it; the English Language Skills and Reading 
tests are given next, and 80 mmutes are allowed for their completion; the Mathematics test is administered last, 
and students are given 90 minutes to work on it. 

Modifications in test format, such as braille, audio cassette,- and large-print materials, are available for 
handicapped students. In addition, the test schedule and administration procedures are modified for handicapped 
examinees. Details of these modifications are provided in the CLAST Institutional Test Administrator's Manual. 
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■ Quality Control 

Test form quality is maintained through an extensive review process. Drafts of new test forms are 
reviewed by staff of the technical support contractor and the Department of Education. After changes in items 
and corrections arc made, there is a thorough review of camera-ready copy, which is followed by a careftil review 
of bluelines. Additional information about the performance of the test is taken from the institutional test 
administrators' and room supervisors' reports and on-site visits to test centers by Department of Education 
personnel. These reports provide information about the quality of test booklets, the standardization of test 
administrations, and the adequacy of allotted test times. 
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rv. TECHNICAL CHARACTERISTICS OF THE CLAST 



ERIC 



To preserve comparability of CLAST scores from one admioistration to the next, test scores are equated 
using a base scale. To ensure reliability and validity of the test and test items, many traditional test analysis 
procedures arc used. This section describes the equating process and procedures used to review the reliability 
and validity of the test. 

■ Test Score Equating 

The Rasch Model 

r> u u J^^ CLAST scale development is based on the logistic response model of Georg Rasch, presented in 
Probabilistic Models for Some Intelligence and Attainment Tests, 1960. Rasch describes a probabilistic model m 
which the probability that a person will answer an item correctly is assumed to be based on the ability of a 
person and the difficulty of the item. These estimates are derived mdependently and are not related to the 
particular sample of people or of items. When the assumptions of the model are met, tests of unequal difficulty 
can be equated. ^ 

Rasch model estimates of person ability and item difficulty are obtained using the unconditional 
maxunum hkehhood estimation procedure described m Wright, Mead, and Bell, BICAL: Calibrating Items With 
the Rasch Model, 1980. The probability of a score is expressed as 



where = a score, = person ability, and 6, = item difficulty. 

Person ability m legits represents the natural log odds for succeeding on items which define the scale 
origm. The item difficulty m logits represents the natural log odds for failure on an item by persons with abilities 
at the scale origin. 

One key assumption of the Rasch model is that a test under consideration is unidimensional. That is 
It measures only one underlying student cognitive abiUty. Unfortunately, abUity is considered to be "latent" and 
cannot be seen or measured in a very precise manner. Therefore, it is important to monitor the performance 
of the test and to condu^i studies that will indicate whether the test is likely to be unidimensional. Thk has been 
done with the CLAST eyammation m two studies. The first study was performed m 1984 with the computation 
est. The second was aone in 1986 with the reading, computation, and writing tests. Both studies showed that 
.the use of Rasch techmqucs is justified. 

Calibration of Items 

Item difficulties are obtained by calibrating the scored items for each administration. Three systematic 
random smnples of 700 records are drawn. The items are calibrated, and the item difficulty logits are averaged 
from the three cahbration samples. Using the averaged difficulties, the item logits are adjusted to the October 
x^o^ Dase scale* 
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Item history records are kept in a computer file and updated after each administration. The stability* 
of Rasch difficulty, discrimination values, and fit statistics are checked, and items that change values by more 
than 3 logit arc flagged for further inspection. In addition, following each administration, items are re-examined 
against established item screening criteria. 

Newly developed or revised items are embedded m^Jbi'A each form of the test and then calibrated and 
adjusted to the base scale. These items arc not counted toward examinees' scores and are not included in the 
initial calibrations used to develop the score scale. After the score scale is created, each test form is recalibrated 
with both the new and the scored items to estimate item difficulties of the new items. The scored items serve 
as a link between the new items in each test form. Item difficulties for the new items are adjusted to the bas. 
scale using the linking constant derived from the comparison of the calibration of the scored items to their base 
item difficulties. For a complete discussion of the method, see Ryan, J., Equating New 1 est Forms to or. Existing 
Test, 1981. 

Generation of Ability Estimates 

The traditional estimate of achievement level is the raw score obtained from the nmnber of correct 
answers provided. The Rasch model is used to generate ability estunates corresponding to the traditional test 
score. 

Adjusted item difficulty logits obtained in item calibration become the basis for estimating person 
abilities. Generation of ability estimates results in a logit ability scale corresponding to the logit difficulty scale 
of items. Rasch ability logits are derived using the unconditional maximiun likelihood estimation procedures of 
the program ABIL-EST (Ryan, 1981). 

The ability estimate corresponding to each raw score between one point and the number of items minus 
one is calculated. (Perfect or zero scores are not included in Rasch calculations.) The ability lo^t scale is then 
centered at the mean for the October 1982 administration and converted to the standard score scale using a 
linear transformation. 

Linking Scaled Scores 

Through the use of Rasch methodology, it is possible to place scores from tests of unequal difficulty on 
the same scale. While" the CLAST difficulty is controlled by selecting items having approximately the same 
average and range of difficulty for each administration, some fluctuation m difficulty may occur in order to use 
items representmg a broad range of content and difficulty. Differences in test form difficulty are controlled by 
equating. 

Tests forms given on two different occasions are equated by using information obtained from a subset 
of items common to both forms. These common items are known as "anchor items." The performance of the 
two groups of examinees on the anchor items is used to adjust the measurement scales for the two forms; the 
measurement scale for the second form is "adjusted" to that of the first form. From a measurement perspective, 
th. examinees in both instances took the same form of the test. For the CLAST, all test forms are equated back 
to the first administration of October 1982. With this approach, all students face identical hurdles in that no 
student has the advantage of an ''easier*' form. 

For each administration, CLAST item difficulties have been adjusted to the base scale of October 1982. 
Item logits obtained from calibrating the scored items are adjusted by adding the linking constant to each item 
logit. The difference m average difficulty represents the shift in overall difficulty between test forms. This 
constant is added to the current item lo^ts to adjust them to the base scale. The stability of the link is evaluated 
by comparing the difficulty values over time to the values in the base scale. 
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■ Reliability of Scores 



estimate ofteSSalnb^^^^^^^^^ -"^-t achievement. It provides an 

ity is bterpreted as the ratio of tr.^lZ^^^'^^^:^^,:^^^'^^^^^^ 

difJerently for multiple-choice scores and essTr^fin^c p f R^habihty is estimated somewha' 

in the foUowing sccdons. ^ with each type of score are described 

Rdiabilifv nf Muttinl.^h«8^ g^^^ 

consistency estunate of reliability, proposed bv Kurf^r 7JT\>-u J' • coeffiaent is an mtemal 



where r^^s 
and ^ pq M 



estimated test reliability, k 
sum of item variances. 



number of test items, = variance of exammees' total scores. 



However^t^:SS:Sirrct?d£^^^^^ °' ^"'^ - multiple-choice tests, 

reported as an mdicator of reUabihty forllStl^^^^^ '^^^^ SEM is also 

of randoi;y%'etl7;S ttl^'^Tr.^'jL'^^^^^^^ °' ^ ^^^'^"^ « ^-^^ number 

Therefore, the SEM L be usedt esTtoa^ '^de:^^^^^ ''^^ ^^^^"^'^ ^^o-. 

mtervals applied to obtained scores are^ot sJZlS a^^^ ""^ "^^"^'"^'^ '""^ ^^'^•'^^"^ 

IS useful m obtaining the center for a confSen^" ne l^^l .f^^^^^ "'^^'^^ ^^^^^^ 

the less dispersed are the parallel tesTsl^re^TItSe^^^^^^ T^' '^f ^"'^^ ^EM, 

score. " """^^ "^e'y estimate is close to the mdividual's true 



The formula for computing the SEM is SEM jTT where * - 
scores and r,= test reUability coefficient ^ " where - 



standard deviation of the test 



(Table 4). 



The KR-20S and SEMs for the CLAST multiple-choice subtests 



indicate they are acceptably reliable 



TABLE 4 

jgujtlple-Choice Raw Score Reliabilltv Stotl«ti«>> 1991-92 



English Language Skills 
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Reliability of Essay Rafings 



Reliability of essay ratings is evaluated in several ways to ensure that raters have adhered to established 
criteria for scormg essays. Consistency m scoring is maintained by training the raters and monitoring the scoring 
process; the reliability of the combined ratings is estimated by coefficient alpha. Both procedures a described 
below. 



Training prior to and during scoring is used to develop and maintain consistency in scoring by the 
mdividual rater and the group of raters. The scoring process is monitored by checking the assignment of ratings, 
the number of split ratings, and the distribution of ratings of each reader. All papers assigned non-contiguous 
ratJ!5^ are submitted to a referee who resolves the split scores. During and after each reading session^ reader 
Tigreement data reflecting the reliability of ratings are reviewed. For the 1991-92 test administrations, the 
percentage of complete agreement between readers for all papers ranged from 38.3 to 413, while the percentage 
of non-contiguous scores ranged from 11.9 to 14.2 (Table 5). The complete agreement, by topic, resulting from 
the assignment to a referee of papers with non-contiguous scores was between 44 and 46% (Table 6). 



TABLES 

Summary Data for Ail E%wy Readers, 1991-92 




October 


February 


June 


NUMBBl 


PBK5ENT 






NUMBER 


PERCBWT 


Total Papers Read 


15.941 


100,0 


18,620 


100.0 


10,656 


^00.0 


Non-Contiguous Scores 


2.261 


14.2 


2.456 


13,2 


1.270 


11.9 


Total Agreement Between 
Readers 


6.106 


38.3 


7,380 


39.6 


4,393 


41.3 



TABLE 6 

Essay Reader Agreement after Referee, 1991-92 




% Complete Agreement 


% Agreement wKhtn One Point 


OCTOBER 


FEBRUARY 




OCrOBER 


FQRUARY 


JUNE 


TOPIC 1 


45 


44 


45 


55 


56 


55 


TOPIC 2 


44 


45 


46 


56 


55 


54 



Reliability of combined ratings for essays is estimated by coefficient alpha, which gives the expected 
correlation between combined ratings of the scoring team and those of a hypothetical par?.'!e! team doing the 
same task. The formula is 



1 - 



where r^^ « coefficient of reliability, k * number of test items, Tsf = sum of item variances, and sf = 
variance of examinees' total scores. 
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Alpha coefficients by topic for the ratings from 1991-92 show they are consistent across topics and ad- 
ministrations (Table 7). 



TABLE 7 1 
Alpha Coefficients, 1991-02 




Non 


hReffMreed Scores 


Refereed Scores 


OCTOBER 




JUNE 


OCXOEBBK 


FSRUART 


JUNE 


TOPIC 1 


.71 


.72 


.73 


.86 


.86 




TOPIC 2 


.71 


.70 


.73 


.87 


.86 


.86 



Reliability of Pass /Fail Classificatinn 

Since CLAST scores are used to detemme whether students m Florida's community coUeires and 
universiUes have achieved the level of performance required for the award of an associate m arts degr^ or for 
admission to upper division status, reliability m tcstJng and retesting is an important issue. The reUability issue 
of mtsrest is whether students would consistently pass or would consistently fail if several parallel forms of the 
test were admmistered to them. The results of a test-retest study conducted m 1984 mdicate that the CLAST 
IS rehable for making pass/fail decisions based on the 1984-86 standards. A complete report of the study is 
available from the Department of Education, and a summary is available in Appendix E 



■ ttem Analysis 

An item analysis such as the one shown in Figure 1 is prepared for the total group of exammees, each 
gender, and each raaal/ethnic category, rhese analyses include the number and percentage of exammees who 
chose each item response, who omitted he item, or who gridded more than one response. In addition, they 
Ssend co^ekdon (proportion of exammees choosing the correct response), item discrimmation, and pomt 

FoUowing test administration, preliminary item analyses are run on the first answer sheets received for 
scoring. R«ults of these analyses are screened for item flaws or key errors. Clues to such errors are low dis- 
crimination indices or Rasch fit statisUcs with high values. Other indicators of problems include lack of balance 
m fod distributions or mordinate difficulty. Items exhibiting these characteristics are flagged and, foUowing a 
Department of Education review, may be excluded from scoring. 

AA A . ''^"^^ embedded m the test forms is another form of quality control. Before an item is 

added to the bank, ,t is pretested as a non-scored item, and its item statistics are reviewed. Items not meeting 
the Item selection cnteria are examined to determine if they are adequate measures of the skills. Any item 
deemed mappropriate is flagged and not used on the CLAST. 
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+ - INDICATES CORRECT ANSWER 

- INDICATES EVERYONE GIVEN CRCOIf 
• - INDICATES QUESTION THROWN OUT 



Figure 1 . Example of an item analysis. 
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BEST COPY AVAILABLE 



Preventing Item Bihs 



In addition to examining item analyses, review paneU established at each stage of test development 
considered the issue of bias in the items. Scatter graphs were exammed after each administration to determme 
u particular items operated differently for various racial or ethnic groups, 

A scatter graph (Figure 2) contrasts performance on individual items by racial/ethnic or gender 
categories. An item difficulty is identified as an outlier if it deviates substantially from the general relationship 
for the compared groups. Consistent differences in item difficulties may indicate only a difference in the level 
of achievement among the compared groups, but items that deviate from thi.s general pattern are further 
examined for content bias that may be related to gender or racial/ethnic background. 
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^^^^^ f^Ses^ ^ ^""^^ "^"^ difficulties comparing the performance of males with that of 



■ Validity of Scores 



score J^S^^'^yS^ T f """^ ^"'"'^ ' '^'"S ^valid." Instead, one should describe a test 

score as being valid for a particular purpose. Hence, test development operations are designed to build 
evidence for a particular type of score interpretation which is defined in advance. 

rn ct f '^'^f f"!' Educational and Psychological Testing (1985) describes three types of validity: content 
nter^^^^^^ ^ V""' '""^ '"^"^^^"^ ^^^^ ^LAST beSSse test scor'e s r e o dy 

cSsT d^^^ r '^7 '^""^ ^^"^'"^ achievement oi designated performance objectives. The 

Cl^ST does not measure a designated psychological characteristic (e.g., spatial visualization), so construct 
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validity is not relevant. Further, as has been stated, the CLAST was not desired to predict a student's future 
performance in school. Hence, the criterion-related (i.e., predictive) validity is not relevant. Content validity 
is substantiated by determining the extent to which the test items adequately measiu^e the specific skills they are 
designed to measure; that is, the extent to which the content of the test matches the set of skills. The validity 
of the test is established by following the plan and procedures for developing and selecting items for each form 
of the CLAST. 



The general plan used in developing the test is outlined below. 

1. General test specifications, consistent with the purpose of the CLAST, are developed by faculty who 
have expertise in both testing and the content areas (English language skills, reading, and matii- 
ematics) with assistance from Department of Education staff. 

2. Item specifications, detailing both the content and the format of items that can be developed to 
measure each of the skills, are developed by faculty with expertise in both the content areas and 
testing, with assistance from Department of Education staff. 

3. Test items are written by faculty according to the guidelines provided by the item specifications and 
are reviewed by faculty and Department of Education staff with careful attention ^ven to content, 
measurement, and bias issues. 

4. Test items are field-tested in community colleges and state universities. 

5. Items are analyzed statistically and selected for use in the test only if they meet (Titeria established 
by Department of Education staff and testing consultants. 

6. A test plan for selection of items is followed in developing alternate forms of the test. 

7. Scaled scores equated to the reference scale are generated using the Rasch model. 

To summarize, validity of the test as a measure of achievement of the skills is established by following 
the plan for developing and selecting items. Content and testing specialists judge the adequacy of the items for 
measuring the skills, and the plan for selecting items ensures that each form of the CLAST is representative of 
the domain of skills being tested. Scores on each of the subtests, then, can be interpreted to be valid indicators 
of students^ achievement of the commurication and mathematics skills measured by the CLAST. 
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V. SCORING AND REPORTING PROCEDURES 



■ Scoring Activnies 

i:^diting Answer Sheet<t 



, Followmg each administration, as answer sheets are received from each institution thev are edited fnr 

or w,th ratmgs that daff er by more than one point are returned to the referee to be corrSted and^Treviewed 
Scoring Conventions 

consider^ Sl^r parameters of number-right scoring, certain conventions are observed: for a response to be 
students' subtest scores below the chance level are compared to their other subtest ^mr^^ if . 

■ Score Scales 

subtes's ^'J^'l"!^?' T^^^ 'T' ^ ^"""^'"'^ ^^^^ administration for each of the multiple-choice 
SLTSctr Ss^^^^^^^^ ^^^ty lo,ts adjusted for ^^.tS 

S, = 30(X4 -0 + 300 

rnra.e';!L'f2l'"'"H-''* ' ff.^J^^^^' ^ " ^^^^^-^ ^982 scale adjustment factor (1.87 f^ 
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TABLES 

ENGUSH LANGUAGE SKiLLS SCORE CONVERSIONS, 1991-S2 




0 
1 
2 
3 
4 
5 
6 
7 
8 
9 
10 
11 
12 
13 
14 
15 
16 
17 
18 
19 
20 
21 
22 
23 
24 
25 
26 
27 
28 
29 
30 
31 
32 
33 
34 
35 



-6.721 
-5.781 
-5.062 
-4.620 
-4.291 
-4.024 
-3.796 
-3.593 
-3.409 
-3.239 
-3.079 
-2.927 
-2.782 
-2.642 
-2.505 
-2.371 
-2.240 
-2.109 
-1.979 
-1.848 
-1.716 
-1.583 
-1.447 
-1.307 
-1.162 
-1.011 
-0.852 
-0.682 
-0.499 
-0.296 
-0.068 
0.200 
0.528 
0.971 
1.692 
2.634 



098 
126 
148 
161 
171 
179 
186 
192 
197 
202 
207 
212 
216 
220 
224 
228 
232 
236 
240 
244 
248 
252 
256 
260 
265 
269 
274 
279 
285 
291 
297 
306 
315 
329 
350 
379 



-6.546 
-5.604 
-4.883 
-4.441 
-4.112 
-3.845 
-3.617 
-3.415 
-3.232 
-3.063 
-2.904 
-2.754 
-2.609 
-2.470 
-2.335 
-2.202 
-2.070 
-1.940 
-1.810 
-1.679 
-1.546 
-1.412 
-1.274 
-1.131 
-0.983 
-0.828 
-0.663 
-0.486 
-0.293 
■0.080 
0.163 
0.448 
0.800 
1.272 
2.032 
3.028 



103 
131 
153 
166 
176 
184 
191 
197 
203 
208 
212 
217 
221 
225 
229 
233 
237 
241 
245 
249 
253 
257 
261 
266 
270 
275 
280 
285 
291 
297 
304 
313 
324 
338 
360 
390 



-6.550 
-5.590 
-4.860 
-4.400 
-4.050 
-3.770 
-3.530 
-3.310 
-3.110 
-2.930 
-2.750 
-2.590 
-2.430 
-2.270 
-2.120 
-1.980 
-1.830 
-1.690 
-1.540 
-1.400 
-1.250 
-1.110 
-0.960 
-0.800 
-0.640 
-0.470 
-0.300 
■0.110 
0.090 
0.310 
0.560 
0.850 
1.210 
1.670 
2.420 
3.400 



103 
132 
154 
168 
178 
186 
194 
200 
206 
210 

217 
222 
227 
231 
236 
240 
245 
249 
253 
258 
262 
266 
271 
276 
280 
285 
291 
296 
302 
309 
316 
325 
336 
350 
372 
402 
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TABLE 9 

READING SCORE CONVERSIONS, 1991-92 



Raw Score 



OCTOBER 



Ability 



Scaled Score 



0 
1 
2 
3 
4 
5 
8 
7 
8 
9 
10 
11 
12 
13 
14 
15 
16 
17 
18 
19 
20 
21 
22 
23 
24 
25 
26 
27 
28 
29 
30 
31 
32 
33 
34 
35 
36 



-5.847 

-4.903 

■4.181 

-3.737 

-3.406 

-3.136 

-2.905 

-2.699 

-2.512 

-2.339 

-2.176 

-2.021 

-1.872 

-1.728 

-1.588 

-1.450 

-1.314 

-1.179 

-1.044 

•0.909 

•0.774 

-0.636 

-0.496 

•0.353 

-0.206 

-0.054 

0.105 

0.273 

0.451 

0.643 

0.855 

1.092 

1.368 

1.706 

2.157 

2.887 

3.842 



124 

152 

174 

187 

197 

205 

212 

219 

224 

229 

234 

239 

243 

248 

252 

256 

260 

264 

268 

272 

276 

280 

285 

289 

293 

298 

303 

308 

313 

31 r 

325 

332 

341 

351 

364 

386 

415 



FEBRUARY 



Ability 



Scaled Score 



-5.850 

-4.910 

-4.190 

-3.750 

-3.422 

-3.157 

-2.930 

-2.730 

-2.549 

-2.382 

-2.225 

-2.077 

-1.936 

-1.799 

-1.667 

-1.538 

-1.411 

-1.286 

-1.160 

-1.035 

-0.909 

-0.783 

-0.654 

-0.522 

-0.387 

-0.246 

-O.0S9 

0.056 

0.222 

0.401 

0.600 

0.824 

1.087 

1.412 

1.850 

2.567 

3.503 



124 

152 

174 

187 

197 

205 

212 

218 

223 

228 

233 

237 

241 

246 

249 

253 

257 

261 

265 

268 

272 

276 

280 

284 

288 

292 

297 

301 

306 

312 

318 

324 

332 

342 

355 

377 

405 



JUNE 



Ability 



Scaled Score 



-5.937 

-4.970 

-4.231 

-3.775 

-3.434 

-3.158 

-2.921 

-2.712 

-2.523 

-2.349 

-2.185 

-2.031 

-1.884 

-1.741 

-1.603 

-1.468 

-1.335 

-1.204 

-1.073 

-0.942 

-0.810 

-0.676 

-0.540 

-0.400 

-0.256 

-0.106 

0.052 

0.219 

0.399 

0.594 

0.811 

1.057 

1.346 

1.703 

2.180 

2.947 

3.952 



121 

150 

173 

186 

196 

205 

212 

218 

224 

229 

234 

239 

243 

247 

251 

255 

259 

263 

267 

271 

275 

279 

283 

288 

292 

296 

301 

306 

311 

317 

324 

331 

340 

351 

365 

388 

418 
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TABLE 10 

MATHEMATICS SCORE CONVERSIONS, 1991-92 


HftW oC0r6 


OCTOBER 


FEBRUARY 


JUNE 




QCBMOl OKXJiW 












0 


-6.377 


108 


^.058 


118 




-6.170 


114 


1 


-5.411 


137 


-5.121 


146 




-5.240 


142 


2 


-4.673 


159 


-4.402 


167 




-4.520 


164 


3 


-4.217 


173 


-3.965 


181 




-4.090 


177 


4 


-3.879 


183 


-3.644 


190 




-3.770 


186 


5 


-3.604 


191 


-3.385 


198 




-3.510 


194 


6 


-3.371 


198 


-3.166 


205 




-3.290 


201 


7 


-3.165 


205 


-2.974 


210 




-3.100 


207 


8 


-2.981 


210 


-2.802 


215 




-2.930 


212 


9 


-2.813 


215 


-2.645 


220 




-2.780 


216 


10 


-2.657 


220 


-2.500 


225 




-2.630 


221 


11 


-2.511 


224 


-2.36C> 


229 




-2.500 


225 


12 


-2.373 


228 


-2.237 


232 




-2.370 


228 


13 


-2.242 


232 


-2.115 


236 




-2.250 


232 


14 


-2.117 


236 


-1.999 


240 




-2.140 


235 


15 


-1.997 


240 


-1.887 


243 




-2.030 


239 


16 


-1.880 


243 


-1.779 


246 




-1.920 


242 


17 


-1.767 


246 


-1.674 


249 




-1.820 


245 


18 


-1.657 


250 


-1.571 


252 




-1.710 


248 


19 


-1.550 


253 


-1.471 


255 




-1.620 


251 


20 


-1.444 


256 


-1.372 


258 




-1.520 


254 


21 


-1.340 


259 


-1.275 


261 




-1.420 


257 


2Z 


-1.237 


262 


-1.178 


264 




-1.330 


260 




-1.135 


265 


-1.083 


267 




-1.240 


262 


24 


-1.034 


268 


-0.988 


270 




-1.140 


265 


ZD 


-0.933 


272 


-0.893 


273 




-1.050 


268 


26 


-0.832 


275 


-0.799 


276 




-0.960 


271 


or 


-0.731 


278 


-0.704 


278 




-0.860 


274 




-0.630 


281 


-0.608 


281 




-0.770 


276 




-0.528 


284 


-0.512 


284 




-0.680 


279 




-0.424 


287 


-0.414 


287 




-0.580 


282 


04 

Ol 


•0.320 


290 


-0.315 


290 




-0.490 


285 


QO 
041 


-0.214 


293 


-0.215 


293 




-0.390 


288 


OO 

OO 


-0.106 


296 


-0.112 


296 




-0.290 


291 


O^ 

34 


0.005 


300 


-0.006 


299 




-0.190 


r,94 


35 


0.119 


303 


0.102 


303 




-0.080 


297 


36 


0.236 


307 


0.214 


306 




0.020 


300 


37 


0.358 


310 


0.331 


309 




0.140 


304 


38 


0.484 


314 


0.453 


313 




0.250 


307 


39 


0.617 


318 


0.581 


317 




0.380 


311 


40 


0.758 


322 


0.717 


321 




0.510 


315 


41 


0.907 


327 


0.862 


325 




0.650 


319 


42 


1.068 


332 


1.019 


330 




0.800 


324 


43 


1.244 


337 


1.191 


335 




0.970 


329 


44 


1.440 


343 


1.383 


341 




1.150 


334 


45 


1.663 


349 


1.602 


348 




1.370 


341 


46 


1.925 


357 


1.861 


355 




1.620 


348 


47 


2.251 


367 


2.183 


365 




1.940 


358 


48 


2.691 


380 


2.620 


378 




2.370 


371 


49 


3.413 


402 


3.338 


400 




3.080 


392 


50 


4.355 


430 


4.274 


426 




4.000 


420 
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The score scale ranges from approximately 100 points to 400 points. It is centered at 300 points, 
designating the state average score on the October 1982 administration. All subsequent examinations are 
equated to this administration. Differences in scaled score ranges across test *'orms occm* as a result of 
differences in the range of item difficulty m test forms. The difficulty of each form is controlled, however, so 
that these shifts m the average score range are small. If one test form has items that are more difficult, it is 
possible to obtain a higher scaled score because the harder items measure a higher level of achievement. 

The essay score is assigned on r scale of two to twelve pomts. Two readers rate each essay on a rating 
scale from one to sue points. The essay score is the sum of the two ratings. The holistic scoring procedure and 
rating scale are discussed in the next section. 



■ Essay Scoring 

Holistic scoring or evaluation, a process for judging the quality of writing samples, has been used for 
many years by testmg agencies in credit-by-exammation, state assessment, and teacher certification programs. 

Holistic Scores 

Essays are scored holistically- that is, for the total, overall impression they make on the reader - rather 
than analytically, which requires careful analysis of specific features of a piece of writing. Holistic scoring 
assumes that the skills which make up the ability to write are dosely mterrelated and that one skill cannot be 
separated from the others. Thus, the writmg is viewed as a total work in which the whole is something more 
than the sum of the parts. A reader reads a writing sample once, forms an impression of its overall quality, and 
assigns it a numerical ratmg based on his/her judgment of how weU the paper meets a particular set of 
established criteria. A six-pomt scale reflecting the follo'>ving performance levels is used to score CLAST essays. 

Score of 6. The paper presents or implies a thesis that is developed with noticeable coherence. The writer's 
ideas are usually substantive, sophisticated, and carefully elaborated. The writer^s choice of 
language and structure is precise and purposeful, often to the point of bemg polished. Control of 
sentence structure, usage, and mechanics, despite an occasional flaw, contributes to the writer's 
ability to communicate the purpose. 

Score o rs, The paper presents or implies a thesis and provides convincing, specific support. The writer's 
ideas are usually fresh, mature, and extensively developed. The writer demonstrates a command 
of language and uses a variety of structures. Control of sentence structure, usage, and mechanics, 
despite an occasional flaw, contributes to the writer's ability to communicate the purpose. 

Score of 4. The paper presents a thesis and often suggests a plan of development, which is usually carried out. 

The writer provides enough supporting detail to accomplish the purpose of the paper. The writer 
makes competent use of language and sometimes varies sentence structure. Occasional errors in 
sentence structure, usage, and mechanics do not interfere with the writer's ability to communicate 
the purpose. 

Score of 3. The paper presents a thesis and often suggests a plan of development, which is usually carried out. 

The writer provides support that tends toward generalized statements or a listing. In general, the 
support is neither sufficient nor clear enough to be convincing. Sentence structure tends to be 
pedestrian and often repetitious. Errors in sentence structure, usage, and mechanics sometimes 
mterfere with the writer's ability to communicate the purpose. 
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Score of 2. The paper usually presents a thesis. The writer provides support that tends to be sketchy and/or 
illogical. Sentence structiu-e may be sunplistic and disjointed. Errors in sentence structure, usage, 
and mechanics frequently interfere with the writer's ability to communicate the purpose. 

Score of 1. The paper generally presents a thesis that is vaguely worded or weakly asserted. Support, if any, 
tends to be rambling and/or superficial. The writer uses language tliat often becomes tangled, 
incoherent, and thus confusing. Errors in sentence structure, usage, and mechanics frequently 
occur. 

Holistic Scoring 

The holistic scoring session must be conducted in a highly organized manner with competent staff 
members who have clearly specified responsibilities. For ten thousand essays, the holistic scoring staff consists 
of a chief reader, three assistant chief readers, twenty table leaders, and one hundred readers. A support staff 
of a manager and five clerks is also required. 

The scoring procedure follows this pattern. Prior to the scoring session, the chief reader and assistants 
sample the total group of essays to choose from each of the two topics examples which dearly represent the 
established standartls for each of the six ratings on the rating scale. These essays are known as range finders. 
In addition, other essays are chosen as training materials during the scoring sessions. 

After range finders and samples are selected, table leaders meet with the chief and assistant chief 
readers to score the samples and determine if the samples clearly represent the six levels of the scale. The 
purpose of this session is to refine the sample selection and to ensure consensus among table leaders. Range 
finders from previous administrations are also reviewed and used in the training to ensure consistency in scoring 
from one administration to another. 

Immediately prior to and intermittently throughout the scoring session, the chief reader trains the 
readers using the range finders and other samples. Immediately after the initial training session, scoring begins. 
Each essay is read by two readers, each of whom assigns it a rating of one, two, three, four, five, or sbc The 
sum of the ratings is the total score assigned to the essay. A total score of five or above is passing for examinees 
first takmg the CLAST before October 1992. 

In situations where the two readers' individual ratings differ by more than one point, the essay is read 
by a third reader, the referee. The referee's rating will replace one of the existing two ratings for a revised total 
score. 

A more complete description of the process is in Procedures for Conducting Holistic Scoring for the Essay 
Portion of the College-Level Academic Skills Test available in the Department of Education office. 

Recruitment of Readers 

Each institution that registers students for the CLAST may participate in the holistic scoring process. 
The chief reader solicits nominations for readers from the chairs of English departments in community colleges 
and universities. Nominations for readers are made on the basis of the candidate's interest in the process, 
willingness to set aside personal standards for jud^g the quality of writing and to undergo training, and 
availability to work over weekends. Candidates must have a minimum of two years' experience teaching 
composition, hold at least a master's degree or equivalent, have a major in English in at least one degree, and 
teach composition as part of their assigned responsibilities. Nominations may include secondary school teachers 
who teach composition at the junior or senior year level in high schools and faculty who teach composition in 
private postsecondary institutions. 
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Upon receiving nominations from department chairs, the chief reader and the Statewide Test 
Administrator ask each nominee interested m becoming a reader to complete and submit an appSn forS 
The forms are used to determine whether appUcants meet the criteria for readers. 



■ Reporting Test Results 

The reports outlined below are generated for each administration. In addition to these reoorts 
d "ri?1 7'- ''^'^^'^ Administrator a computer tape or diskette contSi^S 

. ''^'^ V^^f °« ^^!P°°?«- Th"^. institutions can generate their own reports and update fills of 
tTS^SitSL "'""'"^ correspondence and a data tape format are prodded 

Student Reports 

PreliminaiT Reports-prepa red a t the state and instit..t.«nal wm, 

1. Summary statistics (means, medians, and standard deviations) and frequency distributions of scores 

a. Student classification: 

Community college AJi, program 
Community college A.S. program 
University native student 
University transfer student 

b. Racial/ethnic classification: 

White/non-Hispanic 
Black/non-Hispanic 
Hispanic 

American Indian/Alaskan native 
Asian/Pacific Islander 
Non-Resident Alien 

c. Gender by racial/ethnic classification 
2, Alphabetic roster of examinees' scores 

Final Reports-^prenared at thi> c^nf^ ^^^^ institutional IpvpIc 

1. Means and percents of first-time examinees meeting current standards for 

a. students with 60 or more hours 

b. students with fewer than 60 hours 




Individual Scort Report 
COLLEGE-LEVEL ACADEMIC SKILLS TEST 

DATCOFEXAM: 



INSTmmON 

Below are your scores on the Cotiege-Levei Academic Skills Test in the shaded box on the left »s your essay score m me 
remaining shaded boxes are your three-digit scaie scores for «ach subtest After eacn scaie score is printed tne toiiowmg 
information for e?nh broad skill area of a subtest number of correct answers number of questions - percentage ol items 
answered correctly The enclosed interoretation guide will help vou understand your scores 

ThiS report is only for your information The otftcral record of your scores is kept by your institution on your transcript 
ESSAY ENGUSH LANGUAGE SKILLS READING 




^^^^^ Cf)OiC« 


S«fit«nc« 

Struct uft 


Grammar. 
Gpatling. 
Punctuation. 
Capita lizatton 











fi«naion 
Critical 







MATHEMATICS 



vlCtffMi^^'i Artthmatic 


Algebra 


Geometry • Logical 
Mtaauramant 1 Reasoning 


Sutittict 






1 

1 





Paaaing acoraa on CLAST have baan aataWtahad by th« SUta Board of Education aa lolkma. 

£r>Qiish Lar>auaae * 
Essa) 5kti>& Reaotng Matnemattcs 



Stwianta are required to maat the atandarda in effect at tha time they lirat took the test 
it vou nave auaationa atx>ut your scores, you should contact: 



Figure 3 . Copy, of a blank student report form* 
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c. state university native students 

d. state university transfer students 

e. students by gender and racial ethnic category for each institution, all public institution:*, all private 
mstitutions, all community colleges, and all state universities 

2. Means and perccnts of first-time exammees meeting future standards by gender and racial ethnic 
category for each institution, all public institutions, and all private institutions 

3. Means and perccnts of retake examinees meeting required standards by gender and racial ethnic 
category for each institution, all public institutions, and all private institutions 

Statistical Reports-prepared at the state level only 

1. Rasch item calibrations and fit statistics 

2. Scaled score derivations 

3. Classical item analysis by radal/ethnic classification 

4. Item difficulty plots by gender and racial/ethnic classification 

5. KR-20 coefficients and SEM's for multiple-choice subtests 

6. Interrater reliability for essay scores 

7. Coefficient alpha by gender and radal/ethnic dassification for essay scores 



■ Interpreting and Using Scores 

CLAST scores are reported to indicate students* achievement of those skills upon which the test is based. 
The CLAST scaled scores, not the raw scores, for each subtest are used for this purpose since the scaled scores 
have been adjusted for differences in difficulty in test forms, A scaled score of 300, for instance, represents the 
same achievement IcveUcross forms but may require a higher raw score on an easier form than on a harder 
one. The same scaled score, then, represents the same level of achievement of the skills regardless of the test 
form taken. 

The use of CLAST scores is prescribed by Florida Statutes and Rules of the SBE. Use of scores prior 
to August 1, 1984, was limited to student advising and curriculum unprovement. Since August 1, 1984, students 
in public mstitutions m Florida are required to have CLAST scores which satisfy the standards set forth in Rule 
6A-10.0312, FAC, for the award of an assodate in arts degree and for the admission to upper division status m 
a state university in Florida. However, students who have satisfied CLAST standards on three of the four 
subtests and who are otherwise eligible may be enrolled in state universities for up to an additional thirty-six se- 
mester credits of upper division coursework before they are required to pass the fourth subtest. 

Standards (passing scores) for the CLAST have been adopted by the SBE in Rule 6A-10.0312(1), FAC. 
The standards for each designated period of time are indicated in Chapter IL 

The CLAST was not developed to predict success in upper division programs, but to assess the level of 
achievement of the skills listed in Appendix A. Any use of the scores for selection of students for specific upper 
division programs must be empirically validated. 
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VI. SUMMARY OF 1991-92 RESULTS 



The results of CLAST administrations indicate the level of achievement of communication and 
computation skills by students in community coUeges and state universities. Summary data presented in this 
section describe student performance on the CLAST as a whole and on each subtest. Summary data are based 
on only those students who were first-tune takers m public institutions. 

The mean, standard deviation, and median of raw scores and scaled scores are reported by subtest for 
each administration (Table 11). For each objective subtest, mean scaled scores for the October 1991 
admmistration were higher than the mean scaled scores for the February and June 1992 administrations This 
pattern is not as consistent for other categories of scores, however. 

^ • T ^^^'^^T ^^^^ ^^^'^ *as 62 in October 1991, 57 in February 1992, and 

56 m June 1992 (Table 12). The passmg rates for groups of students classified on the basis of gender or 
racial/ethmc badcground vaned across aU administrations, ranging from a low of 25% in June to a high of 69% 
in October (Table 12), 

Mean scores are reported for aU students, for students grouped according to gender, for students 
grouped accordmg to raaal/etlmic background, for students in community colleges, and for students in the state 
university system. These means are provided separately for the Essay, English Language Skills, Reading, and 
Mathematics subtests and are found in Tables B, 14, 15, and 16, respectively. — & 
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TABLE HI 












Rtw and Scaled Scores, 1991-92 
(First-Time Examinees in Public Institutions) 






1 




RAW SCORE 




SCALED SCORE 




Naof 

mEMS 


MEAN 


STD.DEV. 


MQXAN 


MEAN 


STD.DEV. 


uexAN 


E?$AY 

October 
rworumry 
Jun« 










7.5 
7.3 
7.4 


2.1 
2.0 
2.0 


7 
7 
7 


Enalish Unouaoe Skills 
October 

June 


35 
35 
35 


31.6 
30.5 
29.1 


3.1 
3.1 
3.7 


32 
31 
30 


323.1 
317.2 
315.9 


32,2 
30.3 
29.8 


315 
313 
316 


Readino 

October 
February 
June 


36 
36 
36 


27.5 
28.4 
27.0 


4.6 
4.2 

4.9 


28 
29 
28 


315.7 
312.8 
310.9 


27.0 
24.8 
29.0 


313 
312 
311 


Mathematics 

October 

February 

June 


50 
50 
50 


36.3 
35.9 
37.1 


6.6 
7.2 

6.7 


37 
37 
38 


311.1 
309.5 
308.0 


26.6 
27.8 
26.7 


310 
309 
307 
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TABLE 12 

Percentage of Examinees Passing Aii Four Subtests, 1991-92 
(First-Time Examinees in Public institutions) 


EXAMINEE OnOUP 


OCTOBER 


RSnUART 


JUNE 


Number 
Tested 


Pensent 
Passing 


Number 
Tested 


Percent 

Passing 


Number 
Tested 


Psfoent 
Pttsing 


Ail 


15.976 


62 


18.656 


57 


10,676 


56 


Male 


6,704 


63 


8.332 


59 


4.460 


57 


Female 


9.272 


61 


10,324 


56 


6.216 


55 


White 


11.468 


69 


13.743 


64 


7.575 


65 


Black 


1.809 


35 


1,779 


31 




25 


Hispanic 


1,731 


49 


2,094 


43 


1.471 


39 


Asian/Pacific Islander 


483 


47 


534 


43 


317 


36 


American Indian/Alaskan Native 


52 


67 


50 


60 


33 


67 


Non-Resident Aiien 


353 


39 


363 


39 


226 


32 


Unknown Race 


80 


54 


93 


42 


56 


46 


Community College 


9.184 


56 


11.885 


51 


8.396 


53 


State University System 


6.792 


69 


6,771 


68 


2,280 


67 
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TABLE 13 

Essay Mean Scaled Scores, 1991-92 
(First-Time Examinees In Public Instftullons) 


BCAMtfJEE GROUP 


OCTOBER 


FSRUART 


JUNE 


NumtMT 


a* 




Mm 


Nmber 




Ail 


16.020 


7.5 


18.708 


7.3 


10 710 




Mala 


6,722 


7.3 


8.358 


7.1 


4,479 


7.1 


Famaio 


9.298 


7.6 


10.350 


7.5 


6.231 


7.6 


White 


11.490 


7.8 


13.785 


7.6 


7.590 


7.7 


BJack 


1,818 


6.6 


1,784 


6.5 


1.005 


6.4 


Hispanic 


1.734 


6.9 


2.096 


6.8 


1.481 


6.9 


Asian/Paa'fic IsJander 


483 


6.5 


536 


6.3 


319 


6.2 


American Indian/Alaskan Native 


52 


8.1 


51 


7.9 


33 


7.3 


Non-Resident Alien 


354 


6.2 


363 


6.2 


226 


6.3 


Unknown Race 


81 


7.1 


93 


7.2 


66 


7.0 


Comnnunity College 


9.206 


7,3 


11.902 


7.1 


8.421 


7.3 


State University System 


6.814 


7.3 


6.806 


7.7 


2.289 


7.8 



TABLE 14 

English Language Skills Mean Scaled Scores, 1991-92 
(First-Time Examinees in Public institutions) 


EXAMINEE GROIP 


OCTOBER 


FEBRUART 


JUNE 


NumtMT 


Moan 


Number 


Mean 

■ 


Nunnber 




Ail 


16.035 


323 


18,731 


317 


10.717 


316 


Male 


6,729 


320 


8,373 


315 


4,479 


312 


Female 


9.306 


325 


10,358 


319 


6.238 


318 


White 


11.505 


328 


13.791 


321 


7.596 


321 


BJack 


1,822 


308 


1.788 


302 


1,006 


298 


Hispanic 


1.736 


312 


2.104 


307 


1.479 


306 


Asian/Pacific IsJander 


484 


308 


538 


309 


320 


309 


American Indian/Alaskan Native 


52 


335 


51 


323 


33 


322 


Non-Resident Alien 


356 


305 


368 


303 


226 


305 


Unknown Race 


80 


321 


93 


310 


56 


307 


Community College 


9.214 


319 


11.925 


313 


8,427 


314 


State University System 


6,821 


328 


6,806 


324 


2.290 


322 
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TABLE 15 

Reading Mean Scaled Scores, 1991-92 
(Fir«t-Tlme Examinees In Public Institutions) 


EXAMINS GROUP 


OCTOBB^ 


FEBRUARY 


JUNE 


Numter 








Numbef 




Ail 


16.034 


316 


18.728 


313 


10.717 


311 




6.728 


316 


8,373 


314 


4.479 


312 


Ftmale 


9.306 


315 


10.355 


312 


6.P38 


310 


White 


11.505 


320 


13.790 


317 


7,598 


317 


E»ack 


1.821 


299 


1,787 


298 


1.004 


292 


Hispanic 


1.736 


309 


2.103 


306 


1.480 


301 


Asian/Pacific islander 


484 


302 


538 


299 


320 


295 


Amarican Indian/Aiaskan Native 


52 


323 


51 


313 


33 


316 


Non-Resident Alien 


356 


301 


366 


299 


226 


294 


Unknown Race 


80 


312 


93 


306 


56 


306 


Comnnunity College 


9.216 


312 


11.923 


310 


8.426 


309 


State University System 


6.819 


320 


6.805 


318 


2,291 


317 



TABLE 16 

Mathematics Mean Scaled Scores, 1991-92 
(First-Time Examinees in Public institutions) 


EXAMINEE GROUP 


OGTOBB^ 


f=SRUARr 


JUNE 


NumkMT 


Mavi 


Number 




Number 


Mean 


All 


16.022 


311 


18.710 


309 


10.707 


308 


Male 


6.721 


316 


8.359 


315 


4.476 


314 


Female 


9.301 


307 


10.351 


305 


6,231 


304 


White 


11.495 


314 


13.770 


313 


7.592 


311 


BJack 


1.817 


298 


1.787 


292 


1,004 


2^ 


Hispanic 


1.735 


305 


2,104 


302 


1.477 


303 


Asian/Pacific teJander 


486 


316 


538 


315 


319 


312 


American Indian/Alaskan Native 


52 


312 


50 


310 


33 


312: 


Non-Resident Allen 


357 


311 


368 


315 


226 


311 


Unknown Race 


80 


305 


93 


303 


56 


303 


Community Collese 


9.207 


307 


11.921 


306 


8.410 


306 


State University System 


6.815 


316 


6.789 


316 


2.297 


314 



-34- 



35 

BEST COPY AVAILABLE 



BIBLIOGRAPHY 



"^"'"waThb^o^^^- "^thSSf ^'^'^'^ ^'^^^^"'^ Psychological Testing. 
^'''^'^MeaLt^T4!^.298'^- ^ ^d^'' °f d^P«°dability for mastery tests. Joumai of Educational 

Horida Department of Education. CL4ST Test Administration Manual for Institutional Test 
Administrators, 1986-87. ^ 'n^inuuonai lesi 

Florida Department of Education. CLAST Test Administration Plan, 1986-87. 
Florida Department of Education. CLAST Technical Report, 1982-83. 
Horida Department of Education. CLAST Technical Report, 1983-84. 

"^"'^^ 1'^^::i:l^tjz:l'!1 ^Lr' — - 

HoridaDep„^Ed^u^^^^^^^^^ 

Hambleton. R. KL & Noyick, M. R. (1973). Toward an integration of theory P^d method for criterion- 
referenced tests. /oM/na/ o/£d«cafto«a/ A/eaj««me«/; 70, 159-170. lor criterion 

^^"^^ %^^\r.Tl9m"'' '^^ University of 

Ryan, J. ABIL-EST. (Personal communication with J. Ryan of the University of South Carolina, 1981). 



-35- 



36 

li nM Mi i a ii mii i imw iiiii i iii i ■ i iiiiiiii i H iiiii i i H II III 



ERIC 




APPENDIX A 



■ CLAST Skills Tested, 1991-92 

Essay 

- Select a topic which lends itself to development. 

- Determine the purpose and the audience for writing. 

" aiSln*^^ ^"^'^^'^ '° ^ ^'^'^ ^ developed within the requirements of time, purpose, and 

- Formulate a thesis or main idea statement which reflects the purpose and the focus. 

- Develop the thesis by: 

• WBCT^eS^ ^ '"^^"^ ^^"^ '^^^^ ^^^^ '° distinguish between generalized and 

• Arranging the ideas and supporting details in an organizational pattern appropriate to the 
purpose and focus, ft- f 

• Writing unified prose m which rOl supportmg material is relevant to the thesis or main idea 
stdtctncnt, 

• Writing coherent prose, providing effective transitional devices which clearly reflect the 
orgamzanonal pattern and the relationships of the parts. 

• Avoid mappropriate use of slang, jargon, diches, and pretentious expressions. 

• Use a variety of sentence patterns. 

• Avoid unnecessary use of passive construction. 

• Maintain a consistent pomt of view. 

• Revise, edit, and proofread units of discourse to assure clarity, consistency, and conformity to the 
conventions of standard American English. 

English Language Skills 
Word Choice 

- Use words which convey the denotative and connotative meanings required by context 

- Avoid wordiness. 

Sentence Structure 

• Place modifiers correctly. 

- Coordmate and subordinate sentence elements according to their relative importance. 

- Use parallel expressions for parallel ideas. 

- Avoid fragments, comma splices, and fu.ed sentences. 

Grammar, Spelling Capitalization, and Punctuation 

- Use standard verb forms. 

- Maintain agreement between subject and verb, pronoun and antecedent. 
~ Use proper case forms. 

- Use adjectives and adverbs correctly. 

- Use standard practice for spelling, punctuation, and capitalization. 
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Reading 



Literal Comprehension 

- Pecognize main ideas. 

- Identify supporting details. 

- Determine the meanings of words on the basis of context. 
Critical Comprehension 

- Rec^ '^nize the author's purpose. 

- Identiiy the author's overall organizational pattern. 

- Distinguish between statement of fact and statement of opinion. 

- Detect bias. 

- Recognize the author's tone. 

- Recognize explicit and implicit relationships within sentences. 

- Recognize explicit and implicit relationships between sentences. 

- Recognize valid arguments. 

- Draw logical inferences and conclusions. 



Mathematics 

Arithmetic 



- Add and subtract rational numbers. 

- Multiply and divide rational numbers. 

- Add and subtract rational numbers m decimal form. 

- Multiply and divide rational numbers in decimal form. 

- Calculate percent increase and percent decrease. 

- Recognize the meaning of exponents. 

- Recognize the role of the base number in determining place value m the base-ten numeration system 
and m systems that are patterned after it. Identify equivalent forms of positive rational numbers 
mvolving decimals, percents, and fractions. 

- Determine the order-relation between magnitudes. 

- Identify a reasonable estimate of sxmi, average, or product of numbers. 

- Infer relations betVr'cen numbers m general by exammmg particular number pairs. 

- Select applicable properties for performing arithmetic calculations. 

- Solve real-world problems which do not require the use of variables and which do not involve percent. 

- Solve real-world problems which do not require the use of variables and which do require the use of 
percent. 

- Solve problems that mvolve the structure and logic of arithmetic 
Algebra 

- Add and subtract real numbers. 

- Multiply and divide real numbers. 

- Apply the order-of-operations agreement to computations involving numbers and variables. 

- Use scientific notation in calculations involving very large or very small measurements. 

- Solve linear equations and inequalities. 

- Use given formulas to compute results when geometric measurements are not mvolved. 

- Fmd particular values of a function. 

- Factor a quadratic expression. 
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- Find the roots of a quadratic equation. 

- Recognize and use properties of operations. 

- Determine whether a particular number is among the solutions of a given equation or mequality. 

- Recognize statements and conditions of proportionality and variation. 

■ ^^ecognizc regions of the coordinate plane which correspond to specific conditions. 

- Infer simple relations among variables. 

■ Select applicable properties for solving equations and inequalities. 

■ Solve real-world problems involving the use of variables, aside from commonly used geometric 
formulas. 

- Solve problems that mvolve the structure and logic of algebra. 
Geometry and Measurement 

- Round measurements to the nearest given unit of the measuring device. 

- Calculate distances, areas, and volumes. 

- Identify relationships between angle measures. 

- Classify simple plane figures by recognizing their properties. 

- Recognize similar triangles and their properties. 

- Identify appropriate types of measurement of geometric objects. 

- Infer formulas for measuring geometric figures. 

■ Select applicable formulas for computmg measures of geometric figures. 

- Solve real-world problems involvmg perimeters, areas, and volumes of geometric figures. 

- Solve real-world problems involving the Pythagorean property. 

Logical Reasoning 

- Deduce facts ot set-inclusion or set non-iaclusion trom a diagram. 

- Identify simple and compound statements, and their negations. 

- Determine equivalence or nonequivalencc of statements. 

- Draw logical conclusions from data. 

- Recognize that an argument may not be valid even though its conclusion is true. 

- Distinguish fallacious arguments from nonfalladous ones. 

- Infer valid reasoning patterns and express them with variables. 

- Select applicable rules for transforming statements without affecting thek meaning. 

- Draw logical conclusions when facts warrant them. 

Statistics, Including Probability 

- Identify information contained in bar, line, and circle graphs, 

- Determine the mean, median, and mode of a set of numbers. 

- Count subsets of a ^ven set. 

- Recognize the normal curve and its properties. 

- Recognize properties and interrelationships among the mean, median, and mode in a variety of 
distributions. 

- Choose the most appropriate procedures for selecting an unbiased sample from a target population. 

- Identify the probability of a specific outcome in an experiment. 

- Infer relations and make accurate p edictions from studying particular cases. 

- Solve real-world problems involving the normal curve. 

- Solve real-world problems involving probabilities. 
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■ ^'^^^ Academic Skills Project (CLASP) and 
State-Level Task Force Members, 1991-92 

CLASP Task Fn<rfm rhnfr 

Donald Tighe, VaJenda Community CoUege 

CLASP Staff 

June Siemon, Department of Education 
Edward Croft, Department of Education 

Statewide Test Administrator f STA) 
Jeaninne N. Webb, Director 

Office of Instructional Resources, University of Honda 

Standing Committee nn Stn^^^ t Achievpmpnt 

Robert Stakenas, Chairperson, Horida State University 

Lmda Adau-, Gulf Coast Community College 

R. Scott Baldwin, University of Miami 

Richard Bumette, Horida Southern CoUege 

Jane Chaney, Brevard County Schools 

Maura Freeberg, Ft. Uuderdale College 

Ruth Handley, Superintendent of Highlands County Schools 

Robert Judson, Jr., Pasco-Hernando Community (iuege 

L-ola Kerhn, Honda Atlantic University 

Stuart Lilie, University of Central Honda 

Lee Rowell, Orange County School District 

Theodore Wright, Broward Community College 

Communication Task Fnrop M-mhrn 

Rnt^p"?^^'' ^^P^:'^"' Tallahaf^ee Commmiity College 
Robert Fitzgerald. South Honda Community CoUege 
ZeUa Glazer, School Board of Dade County 

Irf Hfr^^'^^^"^ ^^^^^^^^ ^on^gc at Jacksonville 
ins Hart, Santa Fe Community CoUege 

Ann Higgins, Gulf Coast Community CoUege 

Jose Marques, Horida Interaational University 

Ahna Rodriguez, Miami Edison High School 

Patnaa Stith, Horida State University 

Donald Tighe, Valencia Community CoUege 

Donna Warford-AUey, Daytona Beach Community CoUege 

Willa Wolcott, University of Horida ^ 
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Mathematics Task Force Members 



Karen Walsh, Chairperson, Broward Community College 

Barbara Cotton, Florida A & M University 

Larry Easo"^ Pasco-Hernando Community College 

George Green, Flagler College 

Linda Guifoyle, Palmetto High School 

Mary Henderson, Okaloosa-Walton Community College 

Mary Holton, Central Florida Community College 

Patricia KeUey, University of Miami 

Gayle Kent, Florida Southern CoUege 

Charlene Kincaid, Gulf Breeze High School 

Leonard Lipkin, University of North Florida 

Charles Miles, Hillsborough Community CoUege 

Judy Miller, Leon High School 

Peter Ravcnstrauch, University of Central Florida 
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APPENDIX C 



« Item Review Guidelines 

Overall Factors to Consider in CritiQUiay Items 

1. Adequate measurement of skill 

2. Fairness of items: Items should be free of racial, ethnic, sexual, regional, ard cultural bias. 

3: Quality of stimulus materials (graphics and/or text that provide information required for responding 
to the item): Content should be 

a. pertinent and appropriate for the grade level, 

b. clear and understandable, 

c. believable and realistic, and 

d. familiar to students of all radal/ethnic backgrounds. 

4. Quality of answer choice: The item should contain 

a. one and only one correct answer, neither too obvious and easy nor too difficult and 
obscure, and 

b. good distractors, neither too obviously incorrect nor too 
closely related to the correct answer. 

5. Readability of items and instructions: Readability should follow guidelmes set forth in the test item 
specifications. 

6. Quality of language: The language used should be 

a. clear and concise, 

b. appropriate for the grade level, 

c. appropriate for students of all racial/ethnic backgrounds, and 

d. neither too formal and stilted nor too informal and colloquial. 

7. Technical considerations: Items should be free from flaws such as 

a. too much variation in the length of response options, 

b. clues in the stem which point to the correct answer, 

c. unclear wordmg of the stem or directions, 

d. confusing use of negative words in the stem, and 

e. misleading directions-e.g., asking the student to choose the correct answer when the best 
answer is really called for (as m choosing the best inference, or the evidence that best sup- 
ports a given inference), or vice versa. 



Questions to Consider in Critiquing Item Constnictlon 
1. Stimulus/stem 

a. Does the stem provide ALL THE INFORMATION necessary to answer the question? 

b. Is the desired response evident by reading the stem alone? 

c. Is the f/tem written in the POSITIVE (avoiding not, except, etc.)? 

d. Is the stimulus portion of the item consistent with the Stimulus Attributes ? 
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2. Response options 

a* Is there an appropriate number of options, arranged in a LX)GICAL ORDER (e.g., 
numerical^ alphabetical, chronological)? 

b. Are the options grammatically and conceptually PARALLEL? 

c. Do the options AGREE grammatically with the stem? 

d. Are the options similar and appropriate in LENGTH? 

e. Do the options embody COMMON ERRORS and are they PLAUSIBLE? 

f. Do the options AVOID "all of the above" or "none of the above"? 

3. The entire item 

a. Does the item avoid tricky words, phrases, and constructions? 

b. Is the item free of superfluous material and awkward wording? 

c. Does the item avoid unnecessary clues? 

d. Does the item focus on IMPORTANT aspects of content, not trivia? 



Considerations Id Critiauinig Items for Bias 

An item is considered to be biased if it contains any language or vocabulary that could benefit or 
hinder any group's performance. When reviewing an item for bias, one must consider all of the following groups: 



females 
males 

racial/ethnic groups 
cultural groups 
age groups 

socio-economic groups 



persons with other handicaps 



international groups 
religious groups 



the visually impaired 
the hearing impaired 



regional groups within the U.S. 



As you review each item, consider each of the following questions: 



2. 



Does the item contain any information that could seem offensive to any group? 
Does the item include or hnply any stereotypic depiction of any group? 
Does the item portray any group as degraded in any way? 

Does the item contain any group-specific language or vocabulary (e.g., culture-related expressions, 
slang, or expressions) that may be unfamiliar to particular examinees? 
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APPENDJX D 



■ CLAST Item Dwelopment Team, 1991-92 

Project Director 

Ora Kromhout, Florida State University 

Project Manager 

Peggy StiUwell, Florida State University 

Reading 

Warren Almand, Chipola Junior College 

Thomas Cuppett, Lake Sumter Community College 

Helen Dayan, Hillsborough Community College 

Bill Donalson^ Tallahassee Community College 

Antoinette D'Oronzio, Hillsborough Community College 

Mary Gaier, St. Petersburg Community College 

Karen Haas, Manatee Community College 

Clare Hite, University of South Florida 

Glenna Sue Kahn, Miami-Dade Community College 

Carol Kanar, Valencia Community College 

Linda Krupp, Brevard Community College 

Mary Landsman, Santa Fe Commimity College 

Bertha Murray, Tallahassee Commimity CoDege 

Harriett Reeves, Chipola Junior College 

Audrey Roth, Miami-Dade Community College, South 

Nancy Smith, Florida Commimity College at Jacksonville 

Patricia Wade, Santa Fe Community College 

English Language Skills 

Mailin Barlow, Valencia Community College 

Sue Columbo, Florida State University, Developmental Research School 

Deborah Coxwell, Florida State University 

Ellen Edmiston, Hillsborough Community College 

Jack Gill, Okaloosa- Walton Junior College 

Betsy Griffey, Florida Communit>' College at Jacksonville 

Patricia Hare, Brevard Community College 

Iris Hart. Santa Fe Community College 

Ann Higgins, Gulf Coast Community College 

Arden Jensen, Gulf Coast Community College 

Mary Sue Koeppcl, Florida Community College 

Phyllis Luck, Broward Community College 

Patrick McMahon, Tallahassee Community College 

Beth Novinger, Tallahassee Community Cohege 

»S vah Paulk, Okaloosa- Walton Junior College 

Jiane Stevenson, University of Florida 

Donald Tighe, Valencia Community College 
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Mathematics 

Virginia Brock, Leon High School, Ixon County Schools 

Barbara Carbcrry, Flagler College 

Barbara Clem, Florida A & M Umvcrsit>' 

Linda Lou Cleveland, Chipola Junior College 

Guessna Dohrman, Tallahassee Community College 

JoAnn Everett, Chipola Jmiior College 

George Green, Flagler College 

Moana Karsteter, Tallahassee Community CoUege 

Jann Maclnnis, Florida Community College at Jacksonville 

Janice McFatter, Gulf Coast Community College 

Mike Mears, Manatee Commxmity College 

Minnie Schuler, Gulf Coast Community College 

Bob Sharpton, Miami-Dade Community College 

Bruce Teague, Santa Fe Community College 
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APPENDIX E 



m Test-Retest Reliability Of the CU^T 

In 1984, the Department of Education contracted with Dr. F. J. King of the Florida State University 
to study certain aspects of the reliability of the College-Level Academic Skills Test (CLAST). Dr. King prepared 
a report entitled "A Tcst-Retest Study of the Reliability of the College-Level Academic Skills Test." The study 
is available from the Department of Education and is summarized herein. 

Dr. King invited 360 students who had taken the CLAST in September 1984 to take the CLAST 
examination a second time. IVo hundred seventy-four agreed to do so, and 220 usable scores were obtained. 
The students were retested in October 1984 with the same form of the test which had been administered in June 
1984. 

The data were analyzed using several statistics. A Hambleton-Novick (1973) index was calculated to 
obtain an estimate of the decision consistency over two test forms. The Brennan-Kane (1977) index was used 
to obtain an index of decision consistency for a single test administration. The KR-20 (Stanley, 1971) index was 
also calculated because it is a reliability coefficient widely used with norm-referenced tests. 

The Hambleton-Novick index calculated with the 1984 passing criteria resulted in the following: 



Computation 
Reading 
Writing 
Essay 



0.97 
0.86 
0.96 
0.86 



The Brennan-Kane indices for the subtests were as follows: 



Computation 
Reading 
Writing 
Essay 



0.96 
0.96 
0.92 

not applicable 



The KR-20 internal consistency coefficients for the subtests resulted in values of: 



Computation 
Reading 
Writmg 
Essay 



0.83 
0.87 
0.74 

not applicable 



The reliability coefficients varied depending on which test administration was being analyz^^d, the 
relative difficulty of the tests, and the psychometric characteristics of the tests themselves. Further, it must be 
recognized that the reported reliability coefficients will vary for subpopulations (e.g., Hispanic) and will vary 
depending on the placement of the passing criterion. 
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